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1 .  IntroQUCtlon  and  summary. 

In  1907  F.  eoid  T.  fihrenfest  used  a  simple  urn  scheme 

as  a  pedagogic  device  to  elucidate  some  apparent  paradoxes  in 
thermodynamic  theory.  Their  model  undergoes  fluctuations 
intuitively  related  to  fluctuations  about  equilibrium  of  certain 
thermodynamic  systems.  In  view  of  the  oiscord  among  physicists 
we  merely  mention  the  word  "entropy"  and  shall  not  try  to 
force  an  analogy. 

The  original  hhrenfest  scheme  was  defined  as  follows.  ,2N 
balls  are  divided  initially  in  an  arbitrary  manner  between  tv/o 
urns,  1  ana  2,  the  balls  being  numbered  from  1  to  2N.  an  integer 
between  1  and  2N  is  selected  at  random,  each  such  integer  liaving 
probability  1/2N,  anu  the  ball  with  the  number  selected  is 
transferred  from  one  urn  to  the  other.  The  process  is  repeated 


any  number  of  times.  If  nj  and  n^  are  the  numbers  of  balls  in 
urns  1  and  2  respectively  before  a  transfer,  it  is  clear  that 
the  probability  is  n,/(2h)  that  the  transfer  is  from  urn  1  to 
urn  2  and  n^/(2K)  that  it  is  in  the  contrary  airection. 


aet  x'(n)  be  the  number  of  balls  in  urn  1  after  n  transfers, 
and  let  be  the  smallest  integer  m  such  that  x’{m)  “  Ri  given 
triat  x*(o)  *  j.  If  X  -  J  we  call  the  recurrence  time  for 
the  state  k.  If  k  /  j,  we  call  the  first— passage  time  from 
j  to  k.  The  aistribution  of  x'(n).  Known  classically,  was 


derived  by  Kac  as  an  example  of  the  use  of  matrix  methods. 

Kac  then  found  the  mean  and  variance  of  attributing  some  of 

his  methods  to  bhlenbeck.  Frie^^man  founa  the  moment— 
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generating  function  for  x’{n)  (for  the  >j1irenfest  and  more 


general  models)  by  solving  a  difference- 


jrential  equation.^ 


of  the  ^‘•^"-"nfpst  mode] 

a  modified  schem^with  a  continuous  time  parameter,  which  was 
apparently  first  suggested  by  A.  J.  F.  Siegert  In  this 

scheme  there  are  two  urns  and  2N  balls  initially  divided  between 
them  arbitrarily.  Each  ball  acts,  independently  of  all  the 
others,  as  follows:  there  is  a  probability  of  -j  dt  ♦  o{dt)  that 
the  ball  changes  urns  between  t  ana  t  dt,  and  a  probability  of 
1  —  at  ♦  o(dt))  tl«»t  the  ball  remains  in  place  between  t  and 
t  ♦  dt.  Standard  reasoning  then  shows  that  the  total  probability 
of  a  change  by  some  ball  between  t  and  t  ■*■  dt  is  Ndt  ♦  oidt)^ 

"Tiri  tVr«-  I  y  n  pmAKa-Uaj-it  ri  nin  ■  I  I  i|i^  ■ 


*1mi  ' — tunrm  nr  mnfrn  1rrinT~~****  ill  ,  .^hen  a  transfer  occurs,  it 
is  readily  seen  that  the  probabilities  that  it  is  from  urn  1  to 
urn  2  or  from  urn  2  to  urn  1,  respectively,  depend  on  the  relative 
number  of  bails  in  the  two  urns  exactly  as  for  the  original 
Ehrenfest  model.  Thus  we  see  that  the  present  scheme  is  essen¬ 
tially  the  originaV.  Ehrenfest  scheme  where  the  drawings  are  made 
at  random  times,  hs  we  shall  see,  the  time— continuous  scheme  is 
easier  to  handle  analytically. 

Let  x{t)  be  the  number  of  balls  in  urn  1  at  time  t;  we  shall 
sometimes  speax  of  this  number  as  the  state  of  the  system.  Then 
x(t)  is  a  random  function  which  can  take  integer  values  from  0  to 
2N;  x(t)  executes  a  random  walk  -  with  a  "restoring  force"  - 
about  the  equilibrium  value  N.  It  is  clear  that  the  random  walk 
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is  a  Markov  process. 

Let  j  ^  k,  be  the  first— passage  time  from  state  j  to 

jK 

state  k;  that  is,  is  the  infiraum  of  t  such  that  x{t)  ■  k, 
given  that  x(0)  -  j.  Let  L^j^  be  the  recurrent  Ume  for  the 
state  k;  that  is,  Lj^j^  is  the  infimum  of  t  such  that  x(t)  ■  k 
and  x(T)  4  k  for  0  <  T  <  t,  given  that  x(0)  -  k.  We  shall 
discuss  the  probability  distrioutions  of  L^j^  and  Lj^j^. 

The  probability  distribution  of  Ljj^  depends  of  course  on 
the  size  of  the  model  (i.e.,  the  number  N).  When  it  is  necessary 
to  emphasize  this  dependence  v.'e  shall  sometimes  employ  the 

.notation  LjJ[*  in  place  of  L^j^. 

We  shall  use  the  notation  P(A)  for  the  probability  of  the 
event  A;  P(A|B)  for  the  conditional  probability  of  n,  given  B; 
E(X)  for  the  mean,  or  expected  value,  of  the  ranaom  variable  X. 
jjy  the  distribution  of  a  random  variable  X  we  mean  the  function 
(of  say  u)  given  by  P{X  ^  u).  The  statement  tiiat  a  secuence  of 
distributions  converges  to  a  aistribution  F(u)  will  mean 
convergence  at  all  continuity  points  of  F(u). 

Ti.ere  are  two  limiting  situations  in  which  the  distribution 

of  Ljjj  is  of  interest. 

(a)  Consioer  a  simple  thermodynamic  system  such  as  an  ideal 
gas  in  a  container.  Let  us  think  of  the  container  as  consisting 
of  two  halves  which,  however,  are  not  separated  by  a  partition. 
Suppose  that  initially  the  molecules  are  spread  in  a  rather 
uniform  manner  through  the  two  halves  of  the  container,  nccording 
to  classical  kinetic  theory,  if  we  wait  long  enough  a  time  will 
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come,  in  general,  when  ail  the  molecules  are  in  one  half  of  the 

container.  Such  events,  where  the  fraction  of  molecules  in  one 

liulf  of  the  container  is  appreciably  different  from  •j,  are 

evidently  enormously  rare  if  the  number  of  molecules  is  large. 

Correspondingly  we  should  lixe  to  show  that  the  random  variable 

L  where  Ik  —  Nl  is  of  the  order  of  magnitude  of  N,  is  very 
Nk '  ' 

large  with  high  probability  when  N  is  large.  Now  the  mean  of 

0 

L  is  extremely  large  when  N  is  large.  However,  as  Kac  has 

Nk 

observed,  the  standard  deviation  is  of  the  same  order  of  magnitude 
as  the  mean.  Thus  we  cannot  conclude  from  the  values  of  the  first 
two  mo:.ients  that  Ljjj^  is  large  with  high  probability.  A’e  shall 
show,  however,  that  ^  aistribution  of  converges 

<1  _  35  ^  00  provided  k/N  remains  less  than  sane  fixed 

number  Aj  ^  1 .  (Theorem  1 . ) 

The  situation  with  respect  to  wliere  again  k/N  <  A,  <1, 

is  somewhat  different.  If  k/N  is  appreciably  different  from  0, 
a  very  short  recurrence  time  is  not  improbable.  The  distribution 
of  **  ^  "lump"  of  probability  of  magnitude 

k/N  concentrated  near  0,  the  remainder  of  the  distribution  being 
exponential.  (Tlieorem  2.) 

(b)  In  the  theory  of  the  Brownian  motion  and  elsewhere  in 
physics  anc  statistics  an  important  role  is  played  by  the 
stationary  Gaussian  Markov  process  z(t)  which  we  scale  so  that 

E[z(t)]  -  0,  fc[z(t)]^  -  . 

This  process  is  defined  by  the  requirement  that  the  joint  distri¬ 
bution  of  z(t,),  •••,  z(t„)  for  any  distinct  numbers  t,,  •••, 
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is  Gaussian  and  dependent  only  on  the  differences  —  tj  and 
that  the  autocorrelation  function  is  given  by 

n  1  -Itl 

E[z(s)z{t  ♦  s)J  “  2  ® 

If  N  is  large  the  z(t)  process,  under  the  conditional  hypothesis 
that-z(O)  has  an  appi'opriate  value,  is  approximated  by  the 
process 


in  a  sense  described  in  section  6.  (It  should  be  remembered 
that  x(t)  depends  on  N.)  By  considering  the  distribution  of 
where  (k  -  h)/^^  -  ^0  <  ^ ,  N  — ^  we  obtain  in 

Theorem  3  the  Laplace  transform  of  the  distribution  of  L,  the 
first  time  at  which  z(t)  -  -  f 0 .  given  z(0)  -  0.  This  result 
is  not  new,  having  been  obtained  by  Siegert  [10^  and  by  Darling 
(unpublished).  However,  the  present  method  of  derivation  seems 
instructive. 

Results  similar  to  those  given  under  (a)  ana  (b)  are 
obtained  for  the  random  variable  the  first  time  |x(t)  -  N| 

N  -  x,  given  x(j)  ■  R. 


X 
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2 .  The  mathematical  model. 

Suppose  that  there  are  initially  j  balls  in  urn  1  and 
2N  -  j  in  urn  2.  associate  with  the  i^^  ball  a  random  function 
x^{t)  defined  as  follows:  Xj^(t)  is  1  if  the  i^^  ball  is  in 
urn  1  at  time  t,  and  0  otherwise.  From  the  elementary  theory 
of  Markov  processes  (see,  for  example,  Kolmogorov  ,  [7]),  we 
have 

(1)  P(xj^(t)  -  x^(U))  =  -  —  , 

P(x^(t)  *  1  -  x^(0))  -  "  —  . 

We  may  define  the  generating  function  of  Xj^(t)  by 
p(x^(t)  •  o)  ♦  sP(x^(t)  •  l)  . 

Then  the  generating  function  of  x^(t)  is,  from  (1), 


according  as  Xj^(O)  is  0  or  1 .  Since  the  quantities  x^(t), 
i  *  1,  •••,  2N,  are  independent,  the  generating  function  for 
x{t)  -  2  Xj^{t)  is 


.1. 
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(2) 


2N 


^^P[x(t)  «  kIx{0)- 

.  [1  -  .  ( 1  ♦  e-^ )  s]'  [i  .  M 1  -  e"^ )  s]"''"'’ 

^  k 

k-0 

where  we  have  introduced  the  notation  for  P[x(t)*k[x{J)«jj 

Formula  (2)  was  given  by  Siegert  [9], 

because  of  the  simple  nature  of  the  process  under  considera¬ 
tion  it  is  easy  to  show  that  Ljj^  and  are  (measurable)  random 
variables  with  absolutely  continuous  uistributions.  iiie  omit  the 


proof,  '.'.'e  let  be  the  probability  density  of  Ljjj» 


(3) 


Define 


(4) 


(5) 


/^“pj,(y)dy  .  S  u) 


*  ©A""  • 


“i.  ■  ^  /  [(N  -  K)wJ  , 


k  <  N. 


It  is  convenient  to  notice  that  as  N 


(6) 


m, 


=  [x^(2  ^  4  io(^)) .  <  /  0 


where  we  have  put  A  ■  k/N,  and  Q^jr)  is  independent  of  A 


A. 
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3,  Uistrii-iutiur.  of  j  / 

In  this  section  v;e  consider  the  uistribution  of  the  first- 
passage  time  from  state  j  to  state  k  for  large  N,  where  [j-kl 
is  of  the  oruer  of  iuagnltuae  of  N.  iiS  far  as  the  limiting 
oistributions  are  concerned.  v.e  can  restrict  ourselves  without 
loss  of  generality  to  consiaeration  of  k  <  li.  For  example, 

if  j  >  N  >  k  then  we  can  write 

^jk  *  Sk  • 

The  first-passage  time  from  j  to  N,  representing  novement  towards 
equilibrium,  is  negligible  relative  to  and  uoes  not  affect 

the  asymptotic  result.  On  the  other  hand  if  N  >  j  >  k,  we  h.ave 

^jk  - 

and  it  is  not  difficult  to  show  that  i.j.j  is  negligible  compared 

with  i'jjjj* 

li  tne  first  passage  to  the  state  k  occurs  at  time  T,  the 
prooauiiity  that  the  state  at  time  t  is  again  k  is  -  T)  • 

Vie  have  therefore 

*  So  -T)dT,  j  /  k. 

Formula  (7)  io  the  continuous  counterpart  of  a  formula  long  used 
for  discrete  processes  ana  recently  exploited  by  heller  [2]. 
Taxing  Laplace  transforms  of  both  sides  of  (7)  we  have 
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{6)- 


s: 


P^jj(t)e“^  dt 


■/o“ 


Qjjj(t)e  ^  dt 


/ fo 


t)e  ^  dt, 


helo*)  >  0. 

Since  the  quantities  Qjjj(t)  are  polynomials  in  •  as  we  observe 

from  (2),  the  numerator  and  denominator  in  (d)  each  has  a  simple 
pole  at  <r  ■  0  and  their  quotient  is  therefore  analytic  in  the 
circle  I<r|  <  1 . 

(N)  (N) 

For  simplicity  denote  by  Lj^ 

(N)  /  (N) 

Theorem  1 .  The  distribution  function  of  Lj^  /  nij^  converges 
1  -  u  >  o,  ^  N  — >  ®,  provided  k/N  ^  <  1 ,  convergence 

being  uniform  in  k  and  u. 


The  proof  will  bring  out  the  fact  that  likewise 


(9) 


E 


1. 


k/N  $  >, 


Theorem  1  will  follow  from 


Lemma  1.  (o' is  complex.)  Let 


,(N) 


(O') 


r 


,  (K) 

— 5U/mj^ 


du 


Let  |k(H)j-  £e  a  sequence  of  nonnegatiye  integers  such  that 

Ao  ^  Ai  <  1  aa  N  — >>  ®.  Then  (the  convergence  being 
bounded  ana  uniform  proviaed  I  O'  I  0*^  <  1  ) 
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(1U) 


(N)  . 

lim  (<r)  -  ,  I(r|  <  1. 

N  —^03  K  (  N  ) 

,(N) 


The  function  (—<3“)  is  the  "moment— generating  function" 
of  the  random  variable  Lemma  1  then  implies,  it 


is  well  icnown,  that 

(11) 


■  1  —  e 


— u 


uniformly  for  u  >  0  provided  k(N)/N  — >  X  •  Lemma  1  also  implies, 

0 

since  we  have  convergence  in  a  complex  neighborhood  of  O'  •  0,  that 

(N) 


liffl  £ 

N 


(«,)/■ 


k(N) 


(N)  /  (N)  \ 

So  that  (11)  is  still  true  if  we  replace  by  E^Lj^^lUjI. 

how  if  Theorem  1  were  not  true  then  an  £  >  0  and  a  sequence 
^h(N)j,  h(N)/N  <  All  would  exist  such  that  for  infinitely  many  N 


sup  |1  -  e 

O^usoa 


— u 


„/  (N)  /  (N)  ^  \| 

"  *^rh(N)  /  “h(N)  •  71 


>£ 


Extracting  a  convergent  subsetpaence  from  ■|^h(N)/I»|^,  we  are  led  to 
a  contradiction  of  (11  )• 

The  proof  of  Lemma  1,  whici;  is  somewhat  indirect,  proceeds 

IW) 

as  follows.  We  can  obtain  an  expression  for  (o')  by 

(N) 

substituting  o/n  for  o' in  (o),  obtaining 


-fft/m. 


(12) 
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We  can  obtain  an  asymptotic  estimate  of  J)  as  we  shall  see  later. 

However,  a  direct  estimate  of  appears  difficult  to  obtain.  We 

( N ) 

shall  therefore  resort  to  another  expression  for  («r)  which  is 

( N ) 

easier  to  estimate.  Having  estimates  for  (<r)  and  for  J,  ,  we 
can  then  get  an  estimate  which  will  be  necessary  for  Theorem  2. 

Since  a  direct  proof  of  Lemma  1  is  easy  if  all  terms  in  the 
sequence  |k(N)}  are  0  we  can  suppose  k>0.  IfU<k<Nwe  have, 
from  elementary  reasoning,  the  important  relation 

(13)  i'NO  “  4k  4o  • 

On  account  of  the  Markovian  nature  of  the  process,  and  Lj^ 
are  independent  random  variables  ana  the  Laplace  transform  of  the 
distribution  of  their  sum  is  the  product  of  the  Laplace  transforms 
of  their  inuiviau*!  aistributions*  Therefore,  using  (B)  and  (13) 

we  have 
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The  advantage  of  (15)  over  (lit;)  is  that  *  simpler 

function  than 

The  numerator  of  the  last  fraction  in  (15)  is  ^B{N*1,  •jff’/mj^). 
The  denominator,  on  substituting  e“^  -  y,  becomes 


(16) 


f’l.- 

Jo 


ic  2N— k  ^  ^  ^ 

y)  (i-»y)  y  <iy- 


We  now  have  to  estimate  1  as  N  ^  ®  under  the  hypothesis 
^  Ao  <  1.  {■•s  shall  write  simply  k  for  k(N).)  We  shall 

resti;ict  cr  to  the  circumference  of  a  circle,  say  I  O' [  “  J  » 
since  it  is  clearly  sufficient  to  prove  Lemma  1  for  such  a  circle. 


Write 


I  -  ♦  r’  -  1,  +  ,  U  <  <  1  -  Ao  ^  1  • 

Jo  Ji 

k  2N — K 

Making  use  of  (c)  and  the  fact  that  (1  -  y)  (1  ♦  y)  increases 
to  a  maximum  at  y  1  -  k/N  anu  then  decreases,  1  -  k/N  being 


larger  than  6 
(17)  I|  - 


for  sufficiently  large  N,  we  have 


ft’ 


2N— k  ^  ^  ^ 

‘(l4y)^W‘'y  dy 


^  [i^  0(1)]  ♦  o[(i-  £)*'li  ♦  log  n] 


«  JS  [j  o(  1  )]  +  o(m,  )  , 
cr  “ 

I  I  -  1 

where  o(  )  is  independent  of  O'  lor  |cr,  ^  . 
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To  estimate  we  distinguish  the  cases  Ao  >  0  and  Ao  "  0* 

If  Ao  ^  then  can  be  estimated  using  the  method  of  Laplace; 

see  77*  We  obtain  then,  setting  k/N  ■  A,  (see  (6))  , 

(.16)  -  [a^ ( 2 -  A) V'^i'-^At"^  D+odO  “  0(1)3  . 

Going  back  to  (15),  we  have  (1U)  from  (17)  and  (l£>),  since 

^3  (NO,  •=  ^  0  ♦  o(l)3  . 

This  co.apletes  the  proof  oi  Lemiia  1  for  the  case  Aq  >  0.  If 
Ao  ■  0,  the  integral  1;^  can  be  estimated  by  making  a  change  of 
the  variable  of  integration  which  shov/s  the  integral  to  be 
asymptotically  ecuivalent  to  a  beta  function.  V.e  need  not  enter 
into  oetails. 
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4.  Distribution  of 

Theoreift  2 .  nssume  X  “  ^  ^ ^  ^  *  iLSS  £iit 

F^(u)  -  X*  (1  -  A)[l  -  u  ^  0  . 

uniforaly  in  k. 

As  in  the  case  of  Theorem  1 ,  it  is  sufficient  to  prove  that 
the  Laplace  transform  of  the  distribution  of  Ntjjj  approaches 

Ay  *  (l  —  Xq)  /  *  C  ~  Xq ) 


Then  for  every  b  >  0 


lim  sup 
N*^®  b^U<DD 


providea  k/N  •  A  — >  A©  <  1 •  (We  know  from  the  general  theory  of 
Markov  processes  that 


i:X 


(N) 

kk 


See  Feller,  ,  p.  325* ) 

The  relation  which  replaces  (7)  when  j 

(19)  Wijn(t) 


.-Mt 


k  is 

•T)dT, 


the  term  in  (19)  being  the  probability  that  the  system  remains 

in  state  k  the  entire  time  from  0  to  t.  From  (19), 


(20) 


I 


a> 


0  '■kk''’*' 


1  - 


-ovijjRt 


l^rl 


1 

1 


dt 
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If  we  equate  the  right  side  of  (6),  with  j  -  N  and  a  replaced 
by  the  right  side  of  (15)  with  d'/nij^  replaced  by 

'*'6  obtain 


-tTNQ^t 


/r 


-(TNQj^t 


-  4“'  (r&j). 


To  estimate  which  is  the  numerator  of  (l^J  with  o*  replaced 
by  <r/(1  —  X),  we  need  a  pair  of  lemmas. 


Lemma  ii.  Given  c  >  0,  let 


t^(6)  ■  sup 


Then 


max 


tjj(€)  *  Cdog  N)  ,  N  — >  a>. 


Proof.  From  (2),  4»;_(t)  is  the  coefficient  of  s^  in 


— 2t  ^  2  ^  / 

1  -  e  (1  ♦  zs  ♦  s  )  /: 


where  z  *  z(t)  “2(1  ♦  e  ^^)/(1  -  e  ^^).  Since  for  large  N  the 


-17- 
P-141 
Rev.  11—6—50 


root  oi’  the  equation 


“1-  S,  0<§<1,  S  fixed, 

is  approximately  t  ^  log  N,  it  suffices  to  prove  Lemma  2  for 
the  quantities 

(W),..  (N) 


t„{£)  •=  sup 


|c  (t)  -  c  I  I 
t :  max  — - - rsn—* -  >  f  r  , 

U^N  “  J 


N 


where  we  have  set 
{^3)  (1  zs  s") 

4“’  •  . 


Suppose  £  >  0  is  given.  Choose  an  arbitrary  0(.  >  1 ,  Let 
£,  <  £  be  a  positive  number  and  aefine 


(4^4) 


N  -  1,  2,  •••  . 


l«ote  that  is  a  bounded  increasing  sequence.  We  select  £| 

small  enough  so  that  £• »  “ii  W.  wow  define  a  sequence 

S  ^  *’*  follows:  t,  •  t* i£|) ;  tjj^^  for  N  1  is  the 
maximum  of  tj^  and  the  positive  root  of 

(4:5)  j[z(t)  -  2^(1  ♦ 


(Note  that  z(t}  is  monotone  decreasing.)  It  is  then  clear  from 

(25)  that 
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(26) 


tj,  -J  06  log  N , 


00  . 


vie  now  wish  to  show  inductively  thot 


(27) 


mr 


<  £m  for  t  >  t. 


N  -  1,  2, 


Clearly  (27)  holds  for  N  ■  1,  since  £)  <  £  and  tj  =  t*  . 
Suppose  that  (27)  is  true  for  a  general  N.  From  (23), 


(28) 


cU*.)  ,  ,(N)  , 
r  r  r— 1  r— 2 


Using  (27),  (28),  and  the  fact  that  ^  ■T* 

■for  6  >  t jj  , 


(29) 


i4^(t) 


®r 


JiT^iT 


From  the  definition  of  it  is  then  clear  that  (27)  holds  with 

N  replaced  by  N-»  1.  Then  t  >  tjj  implies  that  the  left  side  of 
(27)  is  less  than  6.  Using  (26)  now  completes  the  proof  of 
Lenuna  2. 


^  »  •  iiiS 


Lemaa  3*  assume  k/N  ^  Xi 

max  wif!^(t)  <  e 
U<t^  *** 


,-3(1- A,  )^i;/5 

e 


Lenuna  3  is  an  immediate  consequence  of  a  result  of  S.  Bernstein 
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on  sums  of  independent  random  variaules;  see  Uspensky,  [12^1 
p.  205.  To  apply  Bernstein's  result,  v.e  consider  the  2N  balls 
as  consisting  of  K  pairs,  each  pair  having  initially  one  ball 
in  um  1  and  one  in  urn  2,  letting  Uspensky's  random  variable 
be  the  number  of  balls  from  the  i^^  pair  in  um  1 ,  minus  1 , 
at  time  t.  Now 


■n) 


<  P 


N 

t?, 


S  It 


-n) 


and  the  applicability  of  Bernstein's  result  is  obvious. 

We  now  return  to  the  proof  of  Theorem  2,  To  estimate  the 
integral  I3  defined  in  (21)  write 


Write  the  integral  on  the  right  side  of  (30)  as 

.t„(£)  pw 

"  =  I3  -  X3 

(£) 


tjj(£)  a> 

Jo  "  Jt^ 


for  an  arbitrary  €.  >  0,  where  tjj(£)  is  defined  in  Lemma  2. 
Using  Le;-..ias  2  and  3  we  have 


(31) 


II3!  <  e. 


r 

jt„ 


CD 

e  *  dt  <  £/(N<r)  , 


(£) 


-3(1->I, )  N75 


]. 


“  o[iog  N  e 

Thus  13  l/(N(r).  Putting  this  estimate  in  (21)  and  recalling 


from  Theorem  1  that 


we  get  the  desired  result  from  (20) 
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5,  Intuitive  interpretation. 

Theorem  1  means  intuitively  that  if  we  take  as  our  time 
unit,  the  attainment  of  the  state  k  is  an  occurrence  of  the 
"chance”  type;  that  is,  the  probability  of  attaining  k  during  a. 
given  time  interval  is  almost  independent  of  the  past  history 
of  the  process.  This  interpretation  suggests  that  Theorem  1 
should  be  true  for  more  general  types  of  processes  with  a  central 
tendency. 

Theorem  2  seems  to  mean  that  if  the  initial  state  is  k 
there  is  a  probability  A  of  returning  to  k  before  leaving  its 
immediate  neighborliood ;  tnere  is  a  probability  1  ~  A  of  getting 
completely  away  fror..  the  neigh.torhood  before  the  first  return; 
in  this  case  the  first  return  has  the  uistribution  of  first 
passage  times  given  in  Theorem  1 . 


-22- 
P-141 
Rev,  11—6—50 


6.  Application  to  stationary  Gaussian  Markov  processes. 

In  Theorems  1  and  2  we  considered  rare  or  macroscopic 
fluctuations  of  x(t).  But  if  N  is  large  x(t)  will  for  the  most 
part  deviate  little  from  its  mean  value  N,  and  to  consider  the 
ordinary  fluctuations  of  x(t)  we  consider 

Zj^(t)  =  (x{tj  -  w) /Vn  . 

Let  tj  ,  •  •  * ,  tjjj  be  a  fixed  set  of  nonnegative  numbers.  The 
joint  distribution  of  Zjj(tjJ,  •••,  given  Zjj{U)  “  0, 

approaches  as  U  — ^  co  the  joint  uistribution  of  z(tj),  •'*, 
given  z(j)  •  0,  where  z{t)  is  the  stationary  Gaussian  Markov 
process  with 

1  ~lt  1 

E[2(t)j  -  0,  £.[s(s)z(s-*’t)J  *-^6 

Define  the  random  variable  L  to  be  the  smallest  value  of  t 
for  which  z{t)  *  —  (^0  ^  given  z(0)  *  0.  It  is  intuitively 
clear  that  the  uistribution  of  L  is  given  by  the  limiting  distri¬ 
bution  of  as  K  — >  uj  provided  we  let 

(32)  (x  -  N)  /VN  -^0  • 

n  rigorous  proof  of  this  statement  is  not  difficult  but  we  omit  it. 

To  find  the  limiting  Laplace  transform  for  the  distribution 
of  Lj^jj  under  the  hypothesis  of  (32)  we  consider  (15)  with  0“  >  0 
in  place  of  <T ana  let  k  •=  h  -  .  Tlie  substitution 

e”^  “  y/V^  puts  the  denominator  in  the  form 
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(33) 


^  1 

N  ir 


p,  n  p.  *•  K— &/rr  ^1 

Jo  J  ^CL  (l+y/v^)  y  dy 


1  cx 

where  OL  is  an  arbitrary  number  between  0  and  ^  .  If  0  <  y  <  N 


Ii-£v^  i1+£v!r 

( 1  -  y  /f/H)  (1  ♦  y/  //N) 


1  O  n 


-^Oox 


Hence 


N  „  G5  -y  *2?.oy  <T—^ 

e  '  y  dy , 


The  seconc  ir.tegral  inside  the  bracket  in  (33)  goes  to  0  as 

H  — ^  ju. 

ihe  numerator  of  (15),  i\ith  <T  in  place  of  O’/raj^,  is 


^  B  (N  +  1  ,  o-/2)tJ^/^  . 


rte  thus  have 


Theore.-n  3.  The  Laplace  traitsfor.ii  of  the  distrioution  of  L  is 
Fiven  by 


(34) 


•j  r(cr/2)  j J  e  y  dy 


formula  (34)  was  obtained  by  uiegert  ana  by  uarling  through 
direct  consiueration  of  the  z(t)  process.  It  is  interesting  to 
notice  that  tiic  present  procedure  utilizes  (13)  wiiich  has  no 
coiinterport  for  t)ie  z(t)  process. 


7.  Two-sided  'limits 
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Let  L^j^,  N  >  K,  be  the  first  time  |x(t1  —  Lj  ■  N  —  k, 
given  x(o)  =  N.  Let  L*  be  the  first  time  Iz(tjJ  *  ^0  >  0, 
given  z(j)  *  0.  /arguments  similar  to  those  used  for  Theorems  1 
and  i  give  the  follov.’ing  two  results. 

Theorem  la.  Under  tite  conuittons  of  i'neorem  1  the  limiting 
distribution  of  Lj^j^/m^^  _is  1  —  e  ,  u  >  0. 

Theorem  3‘i*  The  distribution  of  L*  has  tiie  Laplace  transform 
|r<./.)/r  e-  ^  ^  cosh  (2^0  y)  dy  . 


-25- 
?-141 
Rev.  11—0—50 


RaKiinii.NCiiS 

P.  and  T.  iihrenlest,  "Uber  zwei  bekannte  Einwande  gegen 
das  boltzffiannsche  H— Ti.eorem,"  Phvsikalische  Zeitschrift. 

E  (1907)  ,  p.  311 . 

[2]  Feller,  "Fluctuation  ttieory  of  recurrent  events," 
i'ransactions  of  the  n.  M.  3.  .  Vol.  67  (1949),  pp.  9d— 119» 

[3]  «.  Teller,  Introduction  to  Probability .  'Alley,  1950. 

^4j  Bernard  Friearaan,  ".i  simple  urn  model, "  Communications  on 
Pure  and  Applied  Kathetnati cs .  11  (1949),  p.  59. 

^5j  Mark  Kac,  "nandom  V.-alir,  ano  tiie  t'aeory  of  Brownian  motion,” 
Aniericar;  kathematical  honthly .  54  (1947),  P.  369. 

[cj  A.  I.  Khinchin,  Statistical  Mechanics .  Dover,  1949,  pp.  139—145. 
[7J  A.  Kolmogorov,  "Analytischen  methoden  in  der  ’..ahrscheinlich— 
Keitsrechnunr, "  Mathematlsctie  ..nr.alen .  104  (1931  ),  p.  432. 

0.  Polya  and  G.  Czego,  t;ui>aben  u.  j^ehrsatze .  I,  Dover,  1945. 

[93  «)•  P*  Diegert,  "Note  on  the  Ehrenfest  problem,"  Los  Alamos 

Scientific  i-aboratory,  MDDC— 1406  (LaDC- 43B). 

[lOj  A.  J.  F.  Jiegert,  "On  the  first  passage  time  problem,"  (abstract), 
The  Physical  Review.  Vol.  7o  ( 1 94t ) ,  p.  449. 

[[l1j  A.  J.  f.  Siegert,  "On  the  approach  to  statistical  equilibrium," 

The  Physical  ueview,  Voi.  76  (I9a9),  PP»  17u6— 1714. 

[12J  J.  V.  b'spensky,  Introouction  to  .’.athematical  Probability . 
p.  .i05.  • 


